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*  (1 )  Objectives 

-  DCODE  Concepts/Issues 

*  (2)  Experiments 

-  NPG  School 

-  Colorado  State 

*  (3)  Expected  Finai  Product 

*  (4)  DemosA/aiidations 

-  Camtasia  AVIs 

-  Cortex 

-  HSI  Lab 

*  (5)  Software  Development 

*  (6)  Publications 

*  (7)  Lessons  Learned 


(1)  Objectives 
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•  Overall  Objective:  the  development  of  computer-based  methods  for 
obviating  the  probiems  of  the  exchange,  sharing  and  integration  of 
uniquely  held  information  among  decision  participants  in  a 
distributed,  asynchronous  coilaborative  team  environment. 

-  The  project  proposes  an  integration  of  EWail  technologies  with  Knowledge 
Elicitation  Tools  and  develops  a  simplified  subjective  assessment  template 
for  knowledge  elicitation. 

•  This  year:  The  specific  objectives  for  this  year  are  (1)  to  complete  a 
“shrink-wrapped”  version  of  the  DCODE  software  with  (2)  the 
appropriate  audio-visual  training  tools  for  how  to  use  and  apply  the 
DCODE  technology  and  (3)  continued  experimental  validation  of  the 
efficacy  of  the  DCODE  approach  to  individual  and  group  decision 
making. 


DCODE 
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Decision  Making  Appiication  Areas 
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•  Information  Fusion,  Anaiysis  and  Situation 
Assessment 

•  Option  Generation/Seiection 

•  Course  of  Action  (COA) 

Recommendations 

•  Consensus  Buiiding 


Multiple  Options,  Multiple  Information  Items  About  Each  Option 


Two  Problem  Areas  Addressed 
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The  most  important,  high  impact  items 

▲ 

I  #1  How  do  we  improve  the  process 
;  of  getting  to  here... 


#2  How  do  we  form  an 
aggregate  opinion 
from  confiicting  inputs. 


1000’s  of  possibie  decision  reievant  information  items.... 


□CODE  Approach 
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Improve  the  ability  of  both  individual 
and  group  decision  makers  to: 


-  Abstract 

-  Encapsulate 

-  Assess 

-  Share 


...all  decision  relevant  information  items. 


EWall  &  DCODE 
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*EWall:  Architecture  for  the  Abstraction,  Encapsulation  and  Sharing  of  information. 
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EWall  Icon 
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Object  (lOB) 
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DCODEiVrocess  for  capturing  and  displaying  the^^ognitive  assessments  of 

each  information  item  (“what  does  this  mean?”)  / 

•• 

The  DCODE  assessment  “bar” 


'A 


kTvxt 


The  DCODE  assessment  template 


Cognitive  Assessments 
4  Major  Categories 
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(1)  Which  Option? 

e.g.  SEALS,  Marines,  Army 


(2)  Impact  on  Option?  (Color) 

Very  Negative  Negative  Positive  Very  Positive 


(3)  Importance  of  Information?  (Size) 
Average  High  Very  High 


\ 


+  tyybrines 


Typhoon  200  mi. 
NE  of  Guam 


(4)  Quaiity  of  Information? 

Confidence  Timeliness  Credibility 


Information  Abstraction, 
Encapsulation  and  Assessment 
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“Typhoon  has 
serious  and 
very  negative 
effect  on  using 
the  Marines” 


[P  00 

+  lubrines 


Typhoon  200  mi. 
NE  of  Guam 


Perform  DCODE  assmt.  on 
lOBs  that  are  retained 
for  use/sharing  in  final 
decision  making.  (Assessment) 
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\ 

Convert  candidates 
from  original  format 
into  EWall  lOBs 
(Abstraction, 
Encapsulation) 
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lOB  format  can  be  tailored  to 
specific  decision  tasks 
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SpaceShipOne  safely  landed  in  California's  Mojave  Desert  today,  after 
a  brief,  wild  ride  to  suborbital  space.  The  craft  rolled  more  than  30 
times  shortly  afterthe  rockets  fired,  but  pilot  Mike  Melvill  shut  off  the 
enaines  and  keot  aoina  ud.  Radar  showed  the  fliaht  reached  35G.000 
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20  May  Rpt. 
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Sample  Use  of  DCODE  (AVh 


Why  do  we  Recommend  this 
lOB  Configuration? 
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C?  00 
I  I  I  ISEALs 

zodiac 
7  man 
15mph 


•  Display  Real  Estate 

•  Use  of  Pictures 

•  Color  Conflict 


Real  Estate 
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Example:  Three  possible  decision  options, 
12  relevant  information  items  for  each 
option.  “Big  Picture”  requires  display  of 

36  lOBs. 


Default  Cards,  32  on 
1024  X  768  monitor 
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Reduce  size/eliminate  picture 
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Ajg- 17-04  2:23  PM  PST 
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Eliminate  Picture  area 
Go  to  115  X  80  pixels 


Display  of  36  lOBs  on 
1024  X  768  Monitor 
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Reduced  Size 


36  Cards 


Sorting  the  Workspace 
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Option  Comparisons 
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EWall  Workspace  View  -  Baker 
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Another  Approach 
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EWall  Workspace  View  -  Baker 


^X| 


File  Modules  Help 
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Items 
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Most 

Negative 

Items 


Eliminate  lOB  Pictures? 
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It  will  take  2  days  to  repair  the  Stennis  catapult. 

The  reef  is  only  passable  at  high  tide. 

China  has  detained  two  Taiwanese  fishing  vessels. 

Typhoon  Leoni  is  veering  away  from  ops  area. 

Philippine  Minister  of  Defense  will  run  for  President. 

Does  the  lOB  need  a  picture? 

If  so,  what  picture? 

Where  do  we  get  the  picture? 
Is  it  worth  the  time/iost  space? 
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Jones 
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Color  Conflict 
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□CODE  Colors 
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*  (1 )  Objectives 

-  DCODE  Concepts/Issues 

*  (2)  Experiments 

-  NPG  School 

-  Colorado  State 

*  (3)  Expected  Finai  Product 

*  (4)  DemosA/aiidations 

-  Camtasia  AVIs 

-  Cortex 

-  HSI  Lab 

*  (5)  Software  Development 

*  (6)  Publications 

*  (7)  Lessons  Learned 
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(2)  Experiments  &  Findings 
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NPG  School  Experiment 

1 8  Officers 

•  Display:  Text  vs.  lOBs 
Decision:  Positive  vs.  Negative 

Display 


Positive 

Decision 

Negative 


Text  Only 

lOBs 

N=5 

N=5 

N=4 

N=4 

N=9 

N=9 

N=10 


N=8 


N  (tot)=18 


Task: 


SRfmvi 

V 

Syst&ms  Center 
San  Dfego 


•  Volcanic  disaster  in  the  Pacific 

Should  we  recommend  Islandia  as  the  refugee 

site? 

•  Sees  30  information  items  (randomized) 

-  5  decision  criteria 
•  6  items  per  criteria 


SRfmvi 

The  Five  Decision  Criteria  X 


[COMmunications  -  TSPortation  -  LABor-  ADMistration  -  SANitation  ] 

•  Communications  Facilities  (COM) :  As  s  e  s  s  th  e  c  o  m  m  u  n  i  c  ati  o  n  fa  c  i  I  iti  e  s  th  at 
are  available  in  Islandia,  including  land  telephone  systems,  radio,  TV,  cellular 
phone  availability  and  coverage,  etc. 

•  T ransportation  Facilities  (TSP) :  As  s  e  s  s  th  e  tra  n  s  p  o  rtati  o  n  fa  c  i  I  iti  e  s  th  at  a  re 
available  in  Islandia,  including  roads,  docks,  airports,  etc. 

•  Labor  Pool  (LAB):  Assess  the  labor  pool  that  would  be  available  to  staff  the 
camp  in  Islandia,  including  size  of  the  pool,  quality  of  workers,  work 
ethic/tradition,  etc. 

•  Administrative  Ftequirements  (ADM);  Assess  the  administrative  requirements 
needed  to  set  up  the  camp  in  Islandia,  including,  permits,  fees,  environmental 
considerations,  bureaucratic  red  tape,  graft,  bribes,  etc. 

•  Sanitation^ealth)Medical  conditions  (SAN);  Assess  the  sanitation,  health  and 
medical  conditions  expected  in  Islandia,  including  drinking  water,  sewerage 
disposal,  medical  facilities,  infectious  diseases,  etc. 


Decision  Tasks: 
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Osraf*  RwommernlAon: 


5  Criteria  Decisions 


1  Overaii  Decision 


Text  Condition 


subjects) 
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1/30 


....A  cultural  tradition  in  Islandia  is  that  each  worker  is  given  a  single  two  month 
vacation  each  year,  which  he  can  take  anytime  during  the  year.  All  the  employee  has  to 
do  is  give  the  employer  a  one  week  notice  before  going  on  vacation.  This  has  caused 
unexpected  and  disrupted  work  shortages  when  several  employees  elect  to  take  the 
vacation  at  the  same  time.... 


Criterion: 


COM 

r 


TSP 

r 


LAB 

r 


ADM 

r 


SAN 

r 


Submit  > 


[COMmunications  -  TSPortation  -  LABor-  ADMistration  -  SANitation  ] 


Communications  Facilities  (COM):  Assess  the  communication  facilities  that 
are  available  in  Islandia,  including  land  telephone  systems,  radio,  TV,  cellular 
phone  availability  and  coverage,  etc. 

Transportation  Facilities  (TSP):  Assess  the  transportation  facilities  that  are 
available  in  Islandia,  including  roads,  docks,  airports,  etc. 

Labor  Pool  (LAB):  Assess  the  labor  pool  that  would  be  available  to  staff  the 
camp  in  Islandia,  including  size  of  the  pool,  quality  of  workers,  work 
ethic/tradition,  etc. 

Administrative  Ftequirements  (ADM):  Assess  the  administrative  requirements 
needed  to  set  up  the  camp  in  Islandia,  including,  permits,  fees,  environmental 
considerations,  bureaucratic  red  tape,  graft,  bribes,  etc. 
Sanitation/Health/Medical  conditions  (SAN):  Assess  the  sanitation,  health  and 
medical  conditions  expected  in  Islandia,  including  drinking  water,  sewerage 
disposal,  medical  facilities,  infectious  diseases,  etc. 


Read  this,  then  assign 
it  to  one  of  the  five 
criteria 

(do  30  of  these) 


SRfmvi 

lOB  Condition  (9  subjects) 


1/30 

1 

The  environmental  protection  effort  in  Islandia  is  poorly  organized  hand  has  had  littk 
effect.  Environmental  impact  is  not  a  consideration  in  any  awarding  of  construction 
permits. 

<C 

. - 1 

Read  this,  then: 


Title: 

Criterion: 

Effect: 


Submit  >  I 


Assign  a  keyword 
Assign  it  to  a  criterion 
Evaluate  its  effect  on 
the  criterion 


[COMmunications  -  TSPortation  -  LABor-  ADMistration  -  SANitation  ] 

Communications  Facilities  (COM):  Assess  the  communication  facilities  that 
are  available  in  Islandia,  including  land  telephone  systems,  radio,  TV,  cellular 
phone  availability  and  coverage,  etc. 

Transportation  Facilities  (TSP):  Assess  the  transportation  facilities  that  are 
available  in  Islandia,  including  roads,  docks,  airports,  etc. 

Labor  Pool  (LAB):  Assess  the  labor  pool  that  would  be  available  to  staff  the 
camp  in  Islandia,  including  size  of  the  pool,  quality  of  workers,  work 
ethic/tradition,  etc. 

Administrative  Requirements  (ADM):  Assess  the  administrative  requirements 
needed  to  set  up  the  camp  in  Islandia,  including,  permits,  fees,  environmental 
considerations,  bureaucratic  red  tape,  graft,  bribes,  etc. 
Sanitation^ealthJUIedical  conditions  (SAN):  Assess  the  sanitation,  health  and 
medical  conditions  expected  in  Islandia,  including  drinking  water,  sewerage 
disposal,  medical  facilities,  infectious  diseases,  etc. 


(This  experiment  uses  only  the 
subjective  assessment  of  EFFECT, 
does  not  tap  Importance, 
Credibility,  etc.) 


lOBs  Explained 
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INSTRUCTIONS 

You  have  now  evaluated  all  30  items.  Your  last  task  is  to  assign  rating  scores  to  each  criterion,  as  well  as  one 
final  overall  rating.  Your  previous  scoring  of  the  items  has  been  used  to  create  an  "Information  Object"  (lOB)  for 
each  information  item. 

This  lOB  includes  the  information  you  previously  assigned,  i.e.  the  keywords,  the  criterion  and  the  rating.  The 
keywords  are  hyperlinked  to  the  original  text  item  so  that  you  can  call  it  up  for  review  by  simply  clicking  on  the 
key  words.  When  you  do  this,  the  text  will  appear  in  a  window  to  the  right  of  the  display.  The  effect  you  selected 
for  each  item  is  represented  by  the  color  bar  in  the  lOB.  A  sample  lOB  is  presented  below: 

Your  Keyword 
Your  criterion  Assignment 
Your  assessment  of  the  Effect 
on  selecting  Islandia 

The  lOB  items  are  available  to  you  for  review  using  a  drop-down  sorting  menu  that  can  present  all  the  lOBs 
associated  with  all  the  criterion  oryou  can  elect  to  see  only  the  lOBs  associated  with  one  individual  criterion. 


. - Communications 

Transportation 
Co  I  Labor 
—  Administration 


00.  Sanitation 


How  to  sort  your  data 


Decision  Display:  lOB 
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\^ry  Heg. 


\^ry  Pos. 


Submit 


Reset 


Click  on  the  hyperlinked  titles  in  the  lOB  to 
display  the  original  tejct  here. 


Decision  Display:  Text 
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VISWlfAT 


J 


Communications 


T|i$  frwwm9»il?i  p^tlwpeftrtir!  lel?ndifl‘5  poffrU'  prgwltrt  hits  Ms  HU!? 

rriiLa  canaideraljan  a^aiMiaidEni^areoh^liuigoii  [Mr^ 


A  BlmL/a1lDns4?fcl5@  W\  Ielan4^  BhD^BdVi^d~iB  Eme?'QerH:^M€dl[  Eil 

virr  madaqualD  in  Lvim*  4f  hancfing  amfthn;|  otliD  Ihjfn  Iht  sniilhil  disailer  tilualii 


.  The  majof  ports  of  lalemdie  ara  lesa  dun  three  da^s  sailli^  Trorh  tte  primary  dlsaslet 

rg?Dfl??rf  ¥upplV  center  5I  W?n?  hg®  fhrgg-  ®uppty  ®hipf  tn«  flrig  pgnm^ngfilhr  Insds^ 

to  Peuaed  Ir^duick  reaporraa  aasialanr-a. .' 


E¥firY  emaTtoivn  m  Isiandia  has  ^flieael  one  phpre 


.  The  rtiai^  air  rQuIc-Da  Isl^dii  it  Tiurn  Chinr^E!  ThairnulB,  K^wv^i,  requires  lhalwc  IVinMr 
the  r^a1lanoTC-arht3*sl,  at>d  OarhtHellias  denied  permlesnrilD  tty oror their  airspace. The  t*a 
qpbpiii  arfelD  mddrfKtht-niglil  plln  h  Id  usif  andirifei  [Hp«rtijiE  airporl  9Dlhd'1tit‘tt  dplionl 
resulte  In  e4(^ess>¥ely  long  nighle,  llmhe  pargo  capaertv,  and  ^Mee  die  dafly  arhourk  of 
®Mpplli~s  IhgA  cam  Inn^poHjid  1d  Islendia  *' 


SAW-  r  I  r  I  r  I 
Owera*  RecornmerHJjdon: 

r  r  r 


The  items  the  subject 
assigned  to  the 
Communications 
criterion 


lOB  Subjective  Assessment 
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One  Last  Request:  Please  select  one  of  the  options  below  in  terms  of  how  usefui  the  iOBs 
were  in  making  your  scoring  decision  (this  wouid  be  as  versus  just  seeing  the  text  iisting 
of  the  items  you  assigned  to  each  criterion) 


Somewhat 

distracting 

No  Effect 

Heiped 

Somewhat 

Heiped  a  lot 

r 

r 

r 

r 

Submit 

Positive  vs  Negative 
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Vi  of  Subjects  should  make  of  Subjects  should  make 

a  decision  that  is  Positive:  a  decision  that  is  Negative: 

3  of  5  criteria  are  Positive  3  of  5  criteria  are  Negative 


Positive  Criterion:  4  of  the  6  statements  are  positive 
Negative  Criterion:  4  of  the  6  statements  are  negative 


RESULTS 


Subjective  Assessment 


jsFmm 

V 

Syst&ms  Center 
San  Dfego 


7 

6 

5 

4 

3 

2 

1 

0 


□  Max  =  9 

- ^ ^ - 

- ^ - 

- 1 

lOBs  HELP? 


Distract  No  Effect  Somewhat  A  Lot 


Time  Factor 
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25 


Classify  the  30  Make  the  6  decisions 


lOB  subjects  took  an  average  18  seconds  longer 
per  item  to  enter  keyword  and  make  evaluation 


SRfmvi 


TIME  TO  MAKE  THE  6  DECISIONS 


Systems  Center 
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M 

I 

N 

U 

T 

E 

S 


Significant  Difference 


Score  Assignment  to  Criteria 
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m 


Errors: 
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All  criteria  should  have  been  scored  as  either 
positive  or  negative 

-  Assignment  of  a  neutral  rating  is  scored  as  an  error 

-  For  the  lOB  subjects,  whether  the  correct  decision 
was  Positive  or  Negative  was  based  on  the  subject’s 
ratings 

-  For  the  Text  subjects,  correct  decision  was  based  on 
experimenter’s  classification 

-  Reversal  Error  (most  serious):  Positive  group  of 
information  given  a  Negative  rank  (or  vice  versa) 


Errors  in  Criterion  Scoring 


(includes  (includes  (Reversals  (Reversals 

neutral)  neutral)  only)  Only) 
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Score  Assignment  to  Overall 
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Errors 


0 


10 

9 

8 

7 

6 

5 

4 

3 

2 

1 

0 


ERRORS  OVERALL 
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(includes  (includes  (Reversals  (Reversals 

neutral)  neutral)  only)  Only) 


Summary  of  Results 
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No  Differences  between 
Text  and  lOBs 


COlfl 

T3P- 

LAd 

WM; 


fr’  l  r  I  r 


■f'- 


1 

ifc--  M 


r. 


r 


Reset  [ 


Six  of  the  9  I  OB  subjects 
made  the  correct  assignment. 


gAH-  'j  r  r 

Oersrt  Ref  oinmei^Aon: 


None  of  the  9  Text  subjects 
made  the  correct  assignment. 

6/9  of  the  lOB  subjects 
showed  unwillingness  to  commit 
to  a  decision.  Other  3  made 
reversal  errors. 


Summary 
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No  members  of  the  Text  group  made  a 
correct  Overall  decision: 

-  Preferred  the  neutral  rating 

Six  of  the  nine  lOB  group  made  a  correct 
Overall  decision 

Subjects  took  longer  to  make  a  decision 
when  preponderance  of  data  was  Positive 

lOB  subjects  gave  favorable  ratings  to  use 
of  lOBs  in  decision  making 
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The  use  of  Information  Objects  (lOBs) 
and  DCODE  in  decision  making 
(Experiment  at  Colorado  State  4/04) 


Task 
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Select  the  best  company  to  invest  in  out  of  a 
group  of  three.* 

Read  a  report  about  each  company 

-  Profits,  work  force,  CEO,  new  markets,  etc. 

Create  lOBs  about  each  company 

-  Instructed  on  how  to  create  and  use  lOBs  and  the 
□CODE  color  bar  options. 

-  Creation,  layout,  contents,  &  DCODE  options  totally 
under  subjects  control. 

Make  a  final  Rank  Ordering  of  the  3  companies. 
$  incentive  for  best  performance 


A  published,  standardized  task,  correct  answer  based  on  consensus  of  SMEs 


Overview 
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36  subjects  participated 
- 14  Females 
-  22  Males 

15  of  the  subjects  used  the  DCODE  color 
bar  option 


Subjects 
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Males 

Females 

DCODE 

Option 

available 

13  (13) 

8  (2) 

No  DCODE 
Option 

9 

6 

22 

14 

21  (15) 


15 


(XX)  =  #  of  subjects  that  actually  used  DCODE  color  Bar 


36 


DCODE/No  DCODE 
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best  A 

not  very  but 
dominant  in 
market  shares 


[p  p-  1^0  E?  p-  1^0 


Advertising  debt  ratiing 


[p  p-  [^0 


p  ro  d  u  ct/se  rvi  c  e 


pians  to  expand  4.4  biiiion  -  2003 

wo  rid  wide 


[p  p-  1^0 


future 


[p  p-  1^0 


earnings 


Example: 
Use  of 
DCODE 

color  bar 

- ► 


1 2%  over  next  5 
years 


[p  p-  l^o 


earnings 


1:0  managers  to 
workers 


[p  p-  l^o 


ratio 


7.3  years 


[p  p-  l^o 


employment 


14.4  bilidn  Irt  2003 

EKpanci  ils  US  and 

e-Kpect?  1 2% 
increase  in  5  years 

foreign  foCd 
market 

[P  1"  «  09 

rP  f  «  00 

4jrnii^gf 

dominant  maiket 
^harfis  in 
detergents  ^oapa 
diapo^abie  diapers 
ar^d  shampoo 

ini^rease  reeearfh 
end  deveieprnem 
spending  on  new 
low  oaierie  food 

r?  f  ^  00 

C?  f  *  00 

(Jndvtritd 

tn^feci 

High  and  stabia 
VDlunna  of  sales 


good 
low  debt 


HP  f  ®  so 


Example: 

No  usage  of 
DCODE 
color  bar 
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Use  of  DCODE: 

Decision  Performance  (M  &  F  combined) 
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60 

50 

40 

c 

d) 

O  30 
0) 

20 

10 

0 


□  DCODE 
■  No  DCODE 

Used  DCODE  N=15 
No  DCODE  N=21 


Best  Middle  Worst 


Option  Selection 

54%  of  DCODE  users  ranked  Best  choice  as  #1 
33%  of  non-DCODE  users  ranked  Best  choice  as  #1 


28%  of  DCODE  users  ranked  Worst  choice  as  #1 
54%  of  non-DCODE  users  ranked  Worst  choice  as  #1 


Male  vs.  Female 
Use  of  DCODE  color  bar 
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Male  Female 

Male:  N=13  13/13  100% 

Female:  N=8  2/8  25% 


Decision  Quality 
Male  vs.  Female 
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C 

0) 

o 

0 

Q. 


□  Male 

□  Female 


Male:  N-22  Option  Selection 

Female:  N=14 


Male  vs.  Female 
(no  DCODE) 


C 

0) 

o 

Q. 


□  Male 
■  Female 


Option  Selection 
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Male:  Rankings  of  the  9  males  who  did  not  use  DCODE 
Female:  Rankings  of  the  12  Females  who  did  not  use  DCODE 


SUMMARY 
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People  made  better  selections  using  the 
□CODE  option 

People  were  better  at  avoiding  the  worst 
option  when  they  used  DCODE 

Females  were  less  likely  to  use  DCODE 

Comparing  performance  of  males  vs. 
females  who  did  not  use  DCODE.  females 
performed  more  poorly  than  males. 


Organization: 
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*  (1 )  Objectives 

-  DCODE  Concepts/Issues 

*  (2)  Experiments 

-  NPG  School 

-  Colorado  State 

*  (3)  Expected  Finai  Product 

*  (4)  DemosA/aiidations 

-  Camtasia  AVIs 

-  Cortex 

-  HSI  Lab 

*  (5)  Software  Development 

*  (6)  Publications 

*  (7)  Lessons  Learned 


P  V 

(3)  Expected  Final  Product 

Overall  “concept  of  operations”  of  how  to 
best  use  EWall-DCODE  for  selected 
decision  making  paradigms/tasks. 

Set  of  AVIs  on  how  to  create,  sort  and 
share  lOBs. 

High-level  marketing  brief  on  application  of 
□CODE  to  military/intelligence  decision 
making. 


Organization: 
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*  (1 )  Objectives 

-  DCODE  Concepts/Issues 

*  (2)  Experiments 

-  NPG  School 

-  Colorado  State 

*  (3)  Expected  Finai  Product 

*  (4)  DemosA/aiidations 

-  Camtasia  AVIs 

-  Cortex 

-  HSI  Lab 

*  (5)  Software  Development 

*  (6)  Publications 

*  (7)  Lessons  Learned 


(4)  DemosA^alidations 
of  Technology 


•  Cortex 
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Third  Fleet  Flag  Briefing  and  Collaboration  Facility 
(on  Point  Loma).  Four  Major  packages: 


1 .  Display  Space  Management  (DSM) 

2.  Information  Services  (“KWEB”) 

3.  Geospatial  Collaboration  Service  (GCS) 

4.  Geospatial  Replication  Service  (GRS) 


-  Both  an  innovation  and  AND  an  operational 
command  center. 

-  Expect  to  introduce  DCODE  technology  into  Cortex 
on  a  test  basis  in  2005 


Composeable  FORCEnet  Human  Systems 
Integration  Laboratory  (CFnHSI) 
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Located  at  SPAWAR  Systems  Center, 
San  Diego,  operated  by  SPAWAR 
Systems  Command.  EWall/DCODE 
already  installed  in  facility,  which  is 
well  designed  for  both  individual  and 
group  testing  of  DCODE  usability 
concepts. 


Instructional  AVIs 
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The  good  news:  EWALL  has  many  options  (very  flexible). 
The  bad  news:  EWALL  has  many  options  (a  lot  to  learn). 


□CODE  will  produce  of  number  of 
AVI  tutorial  aids  to  simplify  the 
learning  process. 

□CODE  intro 
Creating  lOBs 
^DCODE  Template 
Sorting  lOBs 
^Sharing  lOBs 
Consensus 

Mother  Applications 


Organization: 
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*  (1 )  Objectives 

-  DCODE  Concepts/Issues 

*  (2)  Experiments 

-  NPG  School 

-  Colorado  State 

*  (3)  Expected  Finai  Product 

*  (4)  DemosA/aiidations 

-  Camtasia  AVIs 

-  Cortex 

-  HSI  Lab 

*  (5)  Software  Development 

*  (6)  Publications 

*  (7)  Lessons  Learned 


(5)  Software  Development  and 
Other  Supporting  Tools 


jsFmm 


•  Software  development  and  configuration 
management  is  controlled  by  MIT. 

•  DCODE  project  has  supplied  software 
design  recommendations  for  use  and 
display  of  DCODE  assessment  template. 

•  DCODE  has  created  a  variety  of  AVI 
instructional  videos  introducing  the 
DCODE  concepts. 


Organization: 
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*  (1 )  Objectives 

-  DCODE  Concepts/Issues 

*  (2)  Experiments 

-  NPG  School 

-  Colorado  State 

*  (3)  Expected  Finai  Product 

*  (4)  DemosA/aiidations 

-  Camtasia  AVIs 

-  Cortex 

-  HSI  Lab 

*  (5)  Software  Development 

*  (6)  Publications 

*  (7)  Lessons  Learned 


P  V 

(6)  Recent  &  Planned  Publications'®^ 

Fleming,  R.  &  Cowen,  M.  Improving  Individual  and  Team  Decisions 
Using  Iconic  Abstractions  of  Subjective  Knowledge.  Paper  presented 
at  Command  and  Control  Research  Technology  Symposium  (CCRTS), 
San  Diego,  CA,  June  2004. 


Cowen,  M.  &  Fleming  R.  A  Knowledge  Management  Tool  for 
Collaboration:  Subjective  Tagging  of  Information.”  Paper  presented  at 
the  2004  TTCP  HUM-TP9  Human  Systems  Integration  Workshop, 
Ottawa,  Canada  May  2004. 


Organization: 
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*  (1 )  Objectives 

-  DCODE  Concepts/Issues 

*  (2)  Experiments 

-  NPG  School 

-  Colorado  State 

*  (3)  Expected  Finai  Product 

*  (4)  DemosA/aiidations 

-  Camtasia  AVIs 

-  Cortex 

-  HSI  Lab 

*  (5)  Software  Development 

*  (6)  Publications 

*  (7)  Lessons  Learned 


(7)  Lessons  Learned 
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Critical  Missing  Feature  to  DCODE  is 

the  Absence  of  Automated  Sorting 
Algorithms. 


A  VS.  B 
Most  tofil. 
Items 


Average 

Items 


Most 

Negative 

Items 


These  were  moved  and  sorted  by  hand 
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Possible  Sorting  Interface 

Wide  variety  of  possibilities. 

Options 

Importance 

Impact 


OPTIONS 

IMPORTANCE 

IMPACT 

O  A 

O 

O 

O  B 

o  C 

o  all 

Compare 

Option  A  vs.  Option  B  on 

Importance 


OPTIONS 

IMPORTANCE 

IMPACT 

•  A 

• 

O 

•  B 

o  C 

o  all 
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A  vs  B  on  Importance  Parameter 
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File  Modules 

Help 

B 

Very  High  High  Average 


Option  A 

Option  B 

Option  A 

Option  B 

Option  A 

Option  B 

All  15s 

All  15s 

All  14s 

All  14s 

All  13s 

All  13s 

All  12s 

All  12s 

All  11s 

All  11s 

All  10s 

All  10s 

All  6s 

All  6s 

All  5s 

All  5s 

All  4s 

All  4s 

All  3s 

All  3s 

All  2s 

All  2s 

All  Is 

All  Is 
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Compare 

Option  A  vs.  Option  B  on  Impact 
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OPTIONS 

IMPORTANCE 

IMPACT 

•  A 

O 

• 

•  B 

o  C 

o  all 

Display 
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[P  00 
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Untitled 
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Untitled 

1  1  rn  OPTION  A 

Untitled 

rn — moPTioN  a 

Untitled 

[P  00 

[P  ■S'  00 

[P  00 

[P  00 

OPTION  B 

1 — rn~ioPTioN  B 

1  1  mOPTION  B 

^HZIOF'TION  b 

Untitled 

Untitled 

Untitled 

Untitled 

[P  ■S'  00 

[P  00 

[P  00 

1 — rn~ioPTioN  B 

1  1  mOPTION  B 

^HZIOF'TION  b 

Untitled 

Untitled 

Untitled 

DJ  00 

D3  00 

^^HOF’TION  a 

1  1  mOPTION  A 

Untitled 

Untitled 

[P  ■S'  00 

1  1  1  lOPTION  B 

[P  ■S'  00 

1  1  1  lOPTION  B 

Untitled 

Untitled 

0  ■S'  00 

0  ■S  00 

^^HOF'TION  a 

Untitled 

1  1  mOPTION  A 

Untitled 

0  ■S  00 

0  ■S  00 

^^HOF'TION  a 

1  1  mOPTION  A 

Untitled 
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EWall  is  a  highly  efficient  approach  to  the 

abstraction,  encapsulation  and  sharing 

of  information. 

DCODE  brings  the  critical  element  of 
information  assessment  to  the  decision 
making  process. 

This  added  element  significantly  enhances 
the  ability  of  an  individual  to  form  an 
overall  composite  opinion  as  well  as  for 
a  group  to  reach  consensus  on  option 
recommendation. 
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